How reliable are MEG resting-state connectivity metrics?

MEG offers dynamic and spectral resolution for resting-state connectivity which is unavailable in fMRI. However, there are a wide range of available network estimation methods for MEG, and little in the way of existing guidance on which ones to employ. In this technical note, we investigate the extent to which many popular measures of stationary connectivity are suitable for use in resting-state MEG, localising magnetic sources with a scalar beamformer. We use as empirical criteria that network measures for individual subjects should be repeatable, and that group-level connectivity estimation shows good reproducibility. Using publically-available data from the Human Connectome Project, we test the reliability of 12 network estimation techniques against these criteria. We find that the impact of magnetic field spread or spatial leakage artefact is profound, creates a major confound for many connectivity measures, and can artificially inflate measures of consistency. Among those robust to this effect, we find poor test-retest reliability in phase- or coherence-based metrics such as the phase lag index or the imaginary part of coherency. The most consistent methods for stationary connectivity estimation over all of our tests are simple amplitude envelope correlation and partial correlation measures.